Tensor network decompositions in the presence of a global symmetry 
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Tensor network decompositions offer an efficient description of certain many-body states of a 
lattice system and are the basis of a wealth of numerical simulation algorithms. We discuss how to 
incorporate a global symmetry, given by a compact, completely reducible group Q, in tensor network 
decompositions and algorithms. This is achieved by considering tensors that are invariant under 
the action of the group Q. Each symmetric tensor decomposes into two types of tensors: degeneracy 
tensors, containing all the degrees of freedom, and structural tensors, which only depend on the 
symmetry group. In numerical calculations, the use of symmetric tensors ensures the preservation of 
the symmetry, allows selection of a specific symmetry sector, and significantly reduces computational 
costs. On the other hand, the resulting tensor network can be interpreted as a superposition of 
exponentially many spin networks. Spin networks are used extensively in loop quantum gravity, 
where they represent states of quantum geometry. Our work highlights their importance also in the 
context of tensor network algorithms, thus setting the stage for cross-fertilization between these two 
areas of research. 
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Locality and symmetry are pivotal concepts in the for- 
mulation of physical theories. In a quantum many-body 
system, locality implies that the dynamics are governed 
by a Hamiltonian H that decomposes as the sum of terms 
involving only a small number of particles, and whose 
strength decays with the distance between the particles. 
In turn, a symmetry of the Hamiltonian H allows us to 
organize the kinematic space of the theory according to 
the irreducible representations of the symmetry group. 

Both symmetries and locality can be exploited to ob- 
tain a more compact description of many-body states and 
to reduce computational costs in numerical simulations. 
In the case of symmetries, this has long been understood. 
Space symmetries, such as invariance under translations 
or rotations, as well as internal symmetries, such as par- 
ticle number conservation or spin isotropy, divide the 
Hilbert space of the theory into sectors labeled by quan- 
tum numbers or charges. The Hamiltonian H is by defi- 
nition block-diagonal in these sectors. If for instance, the 
ground state is known to have zero momentum, it can be 
obtained by just diagonalizing the (comparatively small) 
zero momentum block of H. 

In contrast, only in recent times have the far-reaching 
implications of locality for our ability to describe many- 
body systems started to unfold. The local character of 
Hamiltonian H limits the amount of entanglement that 
low energy states may have, and in a lattice system, re- 
strictions on entanglement can be exploited to succinctly 
describe these states with a tensor network (TN) de- 
composition. Examples of TN decompositions include 
matrix product states (MPS) tree tensor networks 
(TTN), two-dimensional tensor product states [2], pro- 
jected entangled-pair states (PEPS) 0, and the multi- 
scale entanglement renormalization ansatz (MERA) [4[. 
Importantly, in a lattice made of N sites, where the 
Hilbert space dimension grows exponentially with N, TN 
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FIG. 1: Examples of tensor networks. 



decompositions often offer an efficient description (with 
costs that scale roughly as N). This allows for scalable 
simulations of quantum lattice systems, even in cases 
that are beyond the reach of standard Monte Carlo sam- 
pling techniques. As an example, the MERA has been 
recently used to investigate ground states in large two- 
dimensional lattice systems of frustrated antiferromag- 
nets |5j and interacting fermions [6|]. 

In this paper we investigate how to incorporate a global 
symmetry into a TN, so as to be able to simultaneously 
exploit both the locality and the symmetries of physi- 
cal Hamiltonians to describe many-body states. Specif- 
ically, in order to represent a symmetric state that has 
a limited amount of entanglement, we use a TN made 
of symmetric tensors. This leads to an approximate, effi- 
cient decomposition that preserves the symmetry exactly. 
Moreover, a more compressed description is obtained by 
breaking each symmetric tensor into several degeneracy 
tensors (containing all the degrees of freedom of the orig- 
inal tensor) and structural tensors (completely fixed by 
the symmetry). This decomposition leads to a substan- 
tial reduction in computational costs and reveals a con- 
nection between TN algorithms and the formalism of spin 
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networks [7] used in loop quantum gravity [1] . 

In the case of a MPS, global symmetries have already 
been studied by many authors (see e.g. p], 0]) both in 
the context of ID quantum systems and 2D classical sys- 
tems. A MPS is a trivalent TN (i.e. each tensor has at 
most 3 indices) and symmetries are comparatively easy 
to characterize. The present analysis applies to the more 
challenging case of a generic TN decomposition. 

We consider a lattice C made of N sites, where each 
site is described by a complex vector space V of finite 
dimension d. A pure state G Y® N of the lattice can 
be expanded as 

d 

l*) = Wn* 2 ...*JV2'--iiv), (1) 

where \i s ) denotes a basis of V for site s G C. A TN de- 
composition for consists of a set of tensors and 
a network pattern or graph characterized by a set of ver- 
tices and a set of (directed) edges. Each tensor T^) sits 
at a vertex v of the graph, and is connected with neigh- 
boring tensors by bond indices according to the edges of 
the graph. The graph also contains N open edges, cor- 
responding to the N physical indices z'i, z'2, • • • , in- The 
d N coefficients (^)i 1 i 2 ---i N are expressed as (Fig. [2ji) 




namely as the tensor product of the tensors on all the 
vertices v G V, where the tensor trace tTr contracts all 
bond indices, so that only the physical indices z'i, z'2, • • • in 
remain on the r.h.s. of Eq. [2j 

We also introduce a compact, completely reducible 
group Q. This includes finite groups as well as Lie 
groups such as O(n), SO(n), U(n), and SU(n). Let 
U : Q — > L(V) be a unitary matrix representation of Q on 
the space V of one site, so that for each g G (5, U g : V — > V 
denotes a unitary matrix and U gi92 = U gi U Q2 . Here we 
are interested in states \Sfr) that are invariant under trans- 
formations of the form U® N [1Q|, 

{U g )* N \9) = I*}, V 5 € g. (3) 

The space V of one site decomposes as the direct sum of 
irreducible representations (irreps) of 

V 9* d a Y a (D a ® V a ) , (4) 

a a 

where V a denotes the irrep labeled with charge a and d a is 
the number of times V a appears in V. We denote by a = 
the charge corresponding to the trivial irrep, so that 
V° = C and Ug = 1. In Eq. [4] we have rewritten the same 
decomposition in terms of a d a -dimensional degeneracy 
space D a . We choose a local basis \i) = \a,a a ,m a ) in V, 




FIG. 2: (i) Four-site state ^ expressed in terms of a ten- 
sor network made of three tensors connected according to a 
directed graph, (ii) Invariance of tensor T in Eq. [7] (iii) 
Invariance of a tensor network of symmetric tensors, Eq. [3] 

where a a labels states within the degeneracy space D a 
(i.e. a a = 1, • • • , d a ) and m a labels states within irrep 
V a . In this basis, U g reads 

U g = (F ® U a g ) . (5) 

a 

Recall that an operator M : V — > V that commutes with 
the group, [M, U g ] = for all g G ^, decomposes as 

M = [M a (g) F) Schur's lemma. (6) 

a 

Our goal is to characterize a TN made of symmetric 
tensors, namely tensors that are invariant under the si- 
multaneous action of Q on all their indices. A symmetric 
tensor T with e.g. two outgoing indices i and j and one 
incoming index k fulfills (Fig. [2jii) 

J2( U ^( V 9h'i( T hk(W f g )kk' = (T) Vj , k ,, Vg G 9, 

ijk 

(7) 

where U, V , and W denote unitary matrix representa- 
tions of Q. Clearly, this choice guarantees that Eq. [3] 
is satisfied (Fig. Qui). Standard group representation 
theory results [11] imply that each symmetric tensor can 
be further decomposed in such a way that the degrees of 
freedom which are not fixed by the symmetry can be iso- 
lated (Fig. [3]). Next we discuss the case of tensors with a 
small number of indices. Recall that an index i of a ten- 
sor is associated with a vector space that decomposes like 
V in Eq. 2J and therefore we can write i = (a, a a , m a ). 

One leg. — A tensor T with one index i is invariant 
only if Q acts trivially on it, so that the only relevant 
irrep is a = 0, and index i = ao labels states within the 
degeneracy space V°. 

Two legs. — Schur's lemma establishes that a symmet- 
ric tensor T with one outgoing index i and one incoming 
index j = (b,/3b,n ) decomposes as (cf. Eq. [6]) 

— (R ab )a a [3 b (S ab )m a n b , S ab = £ a 6^ra a n b - (8) 
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FIG. 3: Decomposition of tensors with one to four indices. 

Therefore, for fixed values of the charges a and 6, (T) in- 
breaks into a degeneracy tensor R ab (where only a — b 
is relevant) and another tensor S ab . R ab contains all 
the degrees of freedom of T that are not fixed by the 
symmetry, whereas S ab is completely determined by Q. 
Another combination of outgoing and incoming indices 
translates into a different form for tensor S ab . 

Three legs. — The tensor product of two irreps with 
charges a and b can be decomposed as the direct sum of 
irreps, 

V a 0V 6 ^07V a c 6 V c , (9) 

c 

where N° b denotes the number of copies of V c that ap- 
pear in the tensor product. For notational simplicity, 
from now on we assume that Q is multiplicity free [12[, 
i.e. N° b < 1, and denote by (S abc ) manb0c the change of 
basis between the product basis |a, m a ) <S> \b, rib) and the 
coupled basis |c, o c ). Then Wigner-Eckart theorem states 
that a symmetric tensor T with e.g. two outgoing indices 
z, j and one incoming index k — (c, 7 C , o c ) decomposes as 

(T)ijk = (R abC )a a (3 b -f c (S abC )m a n b o c ' (10) 

As before, for fixed values of the charges a, 6, c, (T)ijk 
factorizes into degeneracy tensors R abc with all the de- 
grees of freedom and structural tensors S abc (the Clebsch- 
Gordan coefficients) completely determined by the group 
Q. An analogous decomposition holds for any other com- 
bination of incoming and outgoing indices. 

Four legs. — The tensor product of three irreps V a <S> 
W b V c may contain several copies of an irrep Y d . Let 
e be the charge that results from fusing a and 6, V a (g) 
V 6 = e N^ b Y e . We can use those values of e such that 
N^ b N d c 7^ (i.e., such that a and b fuse to e; and e and c 
fuse to d) to label the different copies of Y d that appear 
in V a (g)V 6 0V c . Let (Sf cd ) ma n b o cPd denote the change of 
basis between the product basis \am a ) \brib) \co c ) and 
the coupled basis \dpd\e). Then a symmetric tensor T 
with three outgoing indices z, j and k and one incoming 
index I = (d,5d,Pd) decomposes as 

(T)ijkl = ^^(Re bCd )a a l3b7c5d(Se bCd )rn a ri b o c p d , (H) 




FIG. 4: A TN for a symmetric state |^) e V 0iV of lattice 
C (Fig. [2} is expressed as a linear superposition of spin net- 
works. Only the intermediate charges e and / are shown. 
Additional sums apply to all indices shared by two tensors. 

where the sum is over all relevant values of the charge e. 
Alternatively, T can be decomposed as 

m a n b o c p d 7 

(12) 

/ 

where (SJ bcd )m a n b o c p d denotes the change of basis to an- 
other coupled basis \dpd] f) of Y d obtained by fusing first 
b and c into /, and then a and / into d. The two coupled 
bases are related by a unitary transformation given by the 
6-index tensor F (e.g. the 6-j symbols for Q = SU(2)) 
such that 

Sf cd = ^2(Ff c ) e f Sf cd . (13) 

e 

Since Eqs. [11] and [12] represent the same tensor T, the 
degeneracy tensors R and R are related by 

Rf cd = Y^( F d bc *YfK bcd ' ( 14 ) 
/ 

More generally, a symmetric tensor T with t indices 
i s = (a s , a as , m as ) , where s = 1 , • • • , t , decomposes as 

(T). . . — V (paia 2 -a t ) 
eie2---e t / 

X (^eie 2 2 --e t / )m ai m a < 2 ---m at (15) 

The degeneracy tensors Rele^-'e^ contain all the de- 
grees of freedom of T, whereas the structural tensors 
Seie2-- 'et' are com pl e tely determined by the symmetry. 
Here ei,e2,--- , e t > are intermediate charges that deco- 
rate the inner branches of a trivalent tree used to label a 
basis in the space of intertwining operators between the 
tensor products of incoming and outgoing irreps. A dif- 
ferent choice of tree will produce different sets of tensors 
R and S, related to R and S by F- moves [Hj . 

We can now investigate how the TN decomposes if we 
write each of its tensors T in the (i?, S) form of Eq. [15] 
(see Fig. [4]). For any fixed value of all the charges, the 
whole TN factorizes into two terms. The first one is a TN 
of degeneracy tensors. The second one is a directed graph 
with edges labeled by irreps of Q and vertices labeled by 
intertwining operators. This is nothing other than a spin 
network [7J, a well-known object in mathematical physics 
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linear map T, 



FIG. 5: Product of two symmetric tensors. Only the interme- 
diate charges d, e and / are explicitly shown. Additional sums 
apply to all indices shared by two tensors. The computation 
involves evaluating spin networks. 



and, especially, in loop quantum gravity [8[, where it is 
used to describe states of quantum geometry. Accord- 
ingly, a symmetric TN for the state <G V 0Ar of a lat- 
tice £ of TV sites can be regarded as a linear superposition 
of spin networks with TV open edges. The number of spin 
networks in the linear superposition grows exponentially 
with the size of the TN. The expansion coefficients are 
given by the degeneracy tensors. 

Computationally, the present characterization of a 
symmetric TN is of interest for several reasons. First 
of all, it allows us to describe a state 1^)®^ with spe- 
cific quantum numbers, which are preserved exactly dur- 
ing approximate numerical simulations. Let us consider, 
as an example, the group U(l), with charge n corre- 
sponding to particle number (n = 0, ±1, ±2, • • • ) and the 
group SU(2), with charge j corresponding to the spin 
(j = 0, 1/2, 1, 3/2, • • •). The symmetric TN can be used 
to describe a state with e.g. zero particles (n = 0) and 
zero spin (j = 0) respectively; or, moregenerally, covari- 
ant states with any value of n and j [l0[ . 

Secondly, the (i?, ^-decomposition ([T5|) concentrates 
all the degrees of freedom of a symmetric tensor T in the 
degeneracy tensors i?, producing a more compact descrip- 
tion. For instance, for the U(l) and SU{2) groups, an 
approximation of the ground state of the antiferromag- 
netic Heisenberg spin-^ chain with a MERA of bound 
dimension % = 21 requires 5 and 35 times less parame- 
ters than with non-symmetric tensors respectively [14j . 

In addition, the (i?, ^-decomposition (fT5|) lowers the 
cost of simulations significantly. Consider the multipli- 
cation of two tensors (Fig. [5]) which is central to most 
TN algorithms. Cost reductions come from two fronts: 
(i) Block-sparse matrices. — The most costly step in mul- 
tiplying two tensors T' and T" consists in multiplying two 
matrices M' and M" obtained from T and T" . These 
matrices are of the form of Eq. [HI and therefore their 
multiplication can be done blockwise, 



M = M'M" 



(V 



M" a ) <8> F 



(16) 



(ii) Pre- computation. — Given an (i?, 5) -decomposition 
of tensor T, another (R, ^-decomposition (as required 
e.g. to obtain matrices M' and M" above) involves a 



B! = T(R). 



(17) 



This map T, of which Eq. [13] is an example, is completely 
determined by the symmetry. In those TN algorithms 
that proceed by repeating a sequence of manipulations, 
map T can be pre-computed once and stored in memory 
for repeated usage. As a result, MERA simulations in 
the above U(l) example run up to 10 times faster Q. 

Finally, the connection between symmetric TNs and 
spin networks allow us to import into the context of TN 
algorithms techniques developed to evaluate spin net- 
works in loop quantum gravity. Such techniques can 
be used e.g. to compute the linear map T of Eq. fT71 
Conversely, TN algorithms may also prove useful in loop 
quantum gravity, since they allow e.g. to efficiently ma- 
nipulate superpositions of an exponentially large number 
of spin networks [14]. 
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